CLAIM AMENDMENTS 



Claim Amendment Summary 

Claims pending 

• Before this Amendment: Claims 1-26. 

• After this Amendment: Claims 1-14 and 16-26. 
Non-Elected, Canceled, or Withdrawn claims: 15. 
Amended claims: 1, 7-8, 14, 18 and 22. 

New claims: None. 
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Claims: 



1. (Currently Amended) A method for modeling image attention, 
the method comprising: 

preprocessing an image to generate a quantized set of image blocks; and 

generating a contrast-based saliency map for modeling one-to-three levels 
of image attention from the quantized image blocks ; and 

performing a fuzzy growing operation to extract attended areas from the 
contrast-based saliency map, the fuzzy growing operation comprising: 

partitioning the c ontrast-based saliency map into two mutually 

exclusive areas as a function of classes of pixels comprising attended and 

unattended pixel areas; 

selecting seeds for the fuzzy growing operation according to a set of 

criteria such that a seed has a local maximum contrast with respect to 

other regional perception units and the seed belongs to an attended area; 
grouping pixels in the contrast-based saliency map with gray levels 

that satisfy criteria that indicate attended as compared to unattended 

areas; and 

iteratively growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped . 
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2. (Previously Presented) The method of claim 1, wherein 
preprocessing further comprises: 

resizing the image such that an aspect ratio of the image is maintained; 
transforming the image from a first color space to a second color space 
that is consistent with human perception; and 

making color in texture areas of the image coarser. 

3. (Previously Presented) The method of claim 1, wherein 
generating the contrast-based saliency map further comprises: 

dividing the image subsequent to quantization into multiple perception 
units; and 

calculating a respective contrast of color components for each perception 
unit; and 

normalizing calculated contrasts to smooth the contrasts. 

4. (Previously Presented) The method of claim 1, further 
comprising extracting attended points from the contrast-based saliency map. 

5. (Previously Presented) The method of claim 1, further 
comprising extracting an attended area from the contrast-based saliency map. 
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6. (Previously Presented) The method of claim 1, further 
comprising extracting an attended view from the contrast-based saliency map. 

7. (Currently Amended) A computer-readable medium storing 
computer-program instructions executable by a processor for modeling image 
attention, the computer-program instructions when executed by the processor 
performing operations comprising: 

preprocessing an image to generate a quantized set of image blocks; and 
generating a contrast-based saliency map for three-level contrast-based 
image attention analysis from the quantized image blocks ; and 

performing a fuzzy growing operation to extract attended areas from the 
contrast-based saliency map r the fuzzy growing operation comprising: 

partitioning the contrast-based saliency map into two mutually 
exclusive areas as a function of classes of pixels comprising attended and 
unattended pixel areas; 

selecting seeds for the fuzzy growing operation according to a set of 
criteria such that a seed has a local maximum contrast with respect to 
other regional perception units and the seed belongs to an attended area; 

grouping pixels in the contrast-based saliency map with gray levels 
that satisfy criteria that indicate attended as compared to unattended 
areas; and 

iteratively growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped . 



Serial No.: 10/676,519 8 _ 

Atty Docket No.: MS1-1640US lee@hayeS The Business of IP' U 

Atty/Agent: E. John Fain Ml 

Response to Final Office Action 



8. (Currently Amended) A computer-readable medium storing 
computer-program instructions executable by a processor, the computer- 
program instructions when executed by the processor for modeling image 
attention by operations comprising: 

generating a preprocessed image by: 

resizing the image such that an aspect ratio of the image is 

maintained; and 

if the image is not already in a color space that is consistent with 

human perception, transforming the image from a first color space to a 

second color space that is consistent with human perception; 

quantizing the preprocessed image to generate quantized image 
perception units such that color in texture areas across the quantized image 
perception units are coarser as compared to the image; and- 

generating a contrast-based saliency map from the quantized image 
blocks, the contrast-based saliency map comprising a respective contrast of color 
components for each perception uni t; and 

performing a fuzzy growing operation to extract attended areas from the 
contrast-based saliency map, the fuzzy growing operation comprising: 

partitioning the contrast-based saliency map into two mutually 

exclusive areas as a function of classes of pixels comprising attended and 

unattended pixel areas: 

selecting seeds for the fuzzy growing operation according to a set of 

criteria such that a seed has a local maximum contrast with respect to 

other regional perc eption units and the seed belongs to an attended area; 
grouping pixels in the contrast-based saliency map with gray levels 

that satisfy criteria that indicate attended as compared to unattended 

areas; and 

iteratively growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped . 
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9. (Previously Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
extracting attended points from the contrast-based saliency map. 

10. (Previously Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
extracting an attended view from the contrast-based saliency map. 

11. (Previously Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
extracting an attended view from the contrast-based saliency map, the attended 
view being a rectangle V(C, W, H), where Cdenotes an attention center, and W 
and H are the width and height of rectangle respectively, the attention center 
being a centroid of the contrast-based saliency map. 

12. (Previously Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
determining a size of an attended view in the contrast-based saliency map, the 
size being related to a 1st order central moment of the contrast- based saliency 
map. 
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13. (Previously Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
extracting an attended area from the contrast-based saliency map. 

14. (Currently Amended) The computer-readable medium of claim 8, 
wherein the computer-program instructions further comprise instructions for 
extracting attended areas from the contrast-based saliency map by performing 
[[a]] the fuzzy growing operation on the contrast-based saliency map as a 
function of two classes of pixels to partition the contrast-based saliency map into 
two mutually exclusive areas, the two classes of pixels comprising attended and 
unattended pixel areas. 

15. (Canceled) 

16. (Previousiy Presented) The computer-readable medium of claim 
8, wherein the computer-program instructions further comprise instructions for 
representing the contrast-based saliency map as a fuzzy event in probability 
space to extract attended areas. 
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17. (Previously Presented) The computer-readable medium of claim 
16, wherein the contrast-based saliency map 216 has L gray levels from g 0 to g L -\ 
and the histogram of saliency map is hk, k=0, L-l, and wherein the computer- 
program instructions further for representing the contrast-based saliency map as 
a fuzzy event in probability space further comprise instructions for: 

modeling the contrast-based saliency map by a triplet (ft, k f P), where 
fl={ 96, 9i, ■ ■, 9l-i} and P is a probability measure of the occurrence of gray 
levels, i.e., Pi{g k } = h^h^ 

denoting a membership function fjdjgi) of a fuzzy set 5efi indicating a 
degree of properties comprising attended areas possessed by gray level g k ; and 

representing the properties as a fuzzy event as follows: 
s= 2 and 

computing a probability of the fuzzy event by: 

k=0 



Serial No.: 10/676,519 12 -~ 

Atty Docket No.: MSM640US lee^hayeS The Business of IP™ 

Atty/ Agent: E. John Fain mwi^hayes, 
Responseto Final Office Action 



18. (Currently Amended) A computing device for modeling image 
attention, the computing device comprising a processor coupled to a memory, 
the memory comprising computer computer-program instructions executable by 
the processor for: 

quantizing a preprocessed image to generate quantized image perception 
units such that color in texture areas across the quantized image perception 
units are coarser as compared to the image, the preprocessed image being a 
resized version of the image with an original aspect ratio and in a color space 
consistent with human perception; and 

generating a contrast-based saliency map from the quantized image 
blocks, the contrast-based saliency map comprising a respective contrast of color 
components for each perception unit ; and 

performing a fuzzy growing operation to extract attended areas from the 
contrast-based saliency m ap, the fuzz y growing operation comprising: 

partitioning the contrast-based saliency map into two mutually 

exclusive areas as a function of classes of pixels comprising attended and 

unattended pixel areas; 

selecting seeds for the fuzzy growing operation according to a set of 

criteria such that a seed has a local maximum contrast with respect to 

other regional perception units and the seed belongs to an attended area; 
grouping pixels in the contrast-based saliency map with gray levels 

that satisfy criteria that indicate attended as compared to unattended 

areas; and 

iteratively growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped . 
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19. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions for 
extracting attended points from the contrast-based saliency map. 



20. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions for 
extracting an attended area from the contrast-based saliency map. 

21. (Previously Presented) The computing device of claim 18, 
wherein the computer-program instructions further comprise instructions for 
extracting an attended view from the contrast-based saliency map. 
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22. (Currently Amended) A computing device comprising: 
means for preprocessing an image to generate a quantized set of image 
blocks; aftd 

means for generating a contrast-based saliency map for modeling three- 
levels of image attentions from the quantized image blocks ; and 

means for performing a fuzzy growing operation to extract attended areas 
from the contrast-based saliency map, the fuzzy growing operation comprising: 

partitioning the contrast-based saliency map into two mutually 
exclusive areas as a function of classes of pixels comprising attended and 
unattended pixel areas; 

selecting seeds for the fuzzy growing operation according to a set of 
criteria such that a seed has a local maximum contrast with respect to 
other regional perception units and the seed belongs to an attended area; 

grouping pixels in the contrast-based saliency map with gray levels 
that satisfy criteria that indicat e attended as compared to unattended 
areas; and 

iteratively growing the attended area by using grouped pixel as 
seeds in subsequent fuzzy growth operations until no candidates of the 
perception units can be grouped . 



Serial No.: 10/676,519 15 , ^ 

Atty Docket NO.: MS1-1640US !ee(gHiayeS The Business onp' u 

Atty/Agent: E. John Fain 

;e to Final Office Action 



23. (Previously Presented) The computing device of claim 22, 
wherein the means for generating the contrast-based saliency map further 
comprises: 

means for dividing the image subsequent to quantization into multiple 
perception units; and 

means for calculating a respective contrast of color components for each 
perception unit; and 

means for normalizing calculated contrasts to smooth the contrasts. 

24. (Previously Presented) The computing device of claim 22, further 
comprising means for extracting attended points from the contrast-based 
saliency map. 

25. (Previously Presented) The computing device of claim 22, further 
comprising means for extracting an attended area from the contrast-based 
saliency map. 

26. (Previously Presented) The computing device of claim 22, further 
comprising means for extracting an attended view from the contrast-based 
saliency map. 
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